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Abstract. A new paradigm in sampling theory has been developed recently 
by Lu and Do. In this new approach the classical linear model is replaced by a 
non-linear, but structured model consisting of a union of subspaces. This is the 
natural approach for the new theory of compressed sampling, representation 
of sparse signals and signals with finite rate of innovation. In this article 
we extend the theory of Lu and Do, for the case that the subspaces in the 
union are shift-invariant spaces. We describe the subspaces by means of frame 
generators instead of orthonormal bases. We show that, the one to one and 
stability conditions for the sampling operator, are valid for this more general 
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1. Introduction 

Recently, Lu and Do [19j extended the sampling problem assuming that the 
signals to be sampled belong to a union of subspaces instead of a single subspace. 
This approach represents a new paradigm in sampling theory. 

In the classical setting the signals are assumed to belong to a single space of func- 
tions, usually the Paley- Wiener space of band-limited functions. Since in many ap- 
plications the band-limitedness hypothesis is not realistic, other spaces of functions 
were considered, mainly, shift-invariant spaces (SIS) with very general generators. 
In the approach of Lu and Do, the signals belong to a union of subspaces instead 
of a single one. This simple idea may have a great impact in many applications in 
signal processing, in particular in the emerging theory of compressed sensing [5], 
[8] , [11] and signals with finite rate of innovations [23j . 

To describe the problem, assume that is a union of subspaces from some Hilbert 
space Ti. and a signal s is extracted from J-. We take some measurements of that 
signal. These measurements can be thought of as the result of the application of a 
series of functionals {ipa}a to our signal s. The problem is then to reconstruct the 
signal using only the measurements {fais)}a and some description of the subspaces 
in J-'. The series of functionals define an operator, the sampling operator, acting 
on the ambient space Ti. and taking values in a suitable sequence space. Under 
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some hypothesis on the structure of the subspaces, Lu and Do found necessary 
and sufficient conditions on these functionals in order for the sampling operator 
to be stable and one-to-one when restricted to the union of the subspaces. These 
conditions were obtained in two settings. In the euclidian space and in L'^{R'^). 
In this latter case the subspaces considered were finitely generated shift-invariant 
spaces. 

Blumensath and Davies [3] studied the problem of sampling in union of subspaces 
in the finite dimensional case, extending some of the results in Lu and Do [12]. They 
applied their results to compressed sensing models and sparse signals. In TSl, Eldar 
developed a general framework for robust and efficient recovery of a signal from a 
given set of samples. The signal is a finite length vector that is sparse in some given 
basis and is assumed to lie in a union of subspaces. Aldroubi et al in [2] established 
the existence of an optimal union of subspaces model for a given data set in an 
abstract setting and considered the finite dimensional case and the shift-invariant 
case for L'^{M.'^). They also developed an algorithm to find the model that fits the 
data set. 

There are two technical aspects in the approach of Lu and Do that restrict the 
applicability of their results in the shift-invariant space case. The first one is due 
to the fact that the conditions arc obtained in terms of Riesz bases of translates 
of the SISs involved, and it is well known that not every SIS has a Riesz basis of 
translates. The second one is that the approach is based upon the sum of every 
two of the SISs in the union. The conditions on the sampling operator are then 
obtained using fiberization techniques on that sum. This requires that the sum of 
each of two subspaces is a closed subspace, which is not true in general. 

In this article we obtain the conditions for the sampling operator to be one-to- 
one and stable in terms of frames of translates of the SISs instead of orthonormal 
basis. This extends the previous results to arbitrary SISs and in particular removes 
the restrictions mentioned above. It is very important to have conditions based 
on frames, specially for applications, since frames are more flexible and simpler to 
construct. Frames of translates for shift-invariant spaces with generators that are 
smooth and with good decay can be easily obtained. 

On the other side we show that, using known results from the theory of SISs, it 
is possible to determine families of subspaces on which the conditions for stability 
and injectivity are necessary and sufficient. 

The article is organized in the following way: Section 2 contains some notation 
and basic results that will be needed throughout. In Section 3 we set the problem 
of sampling in a union of subspaces in the general context of an abstract Hilbert 
space. We also give injectivity and stability conditions for the sampling operator, 
within this general setting. The case of finite-dimensional subspaces is studied in 
Section 4. In Section 5 we analyze the problem for the Hilbert space L^(R") and 
sampling in a union of finitely generated shift-invariant spaces. Finally in Section 
6 we use the notion of angle between subspaces to obtain necessary and sufficient 
conditions for the closedness of the sum of two shift-invariant spaces. 

2. Preliminaries 

We will assume that I and J are countable index sets and 7i is a separable 
Hilbert space over the complex field. 
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Definition 2.1. A sequence X ~ {xj}jeJ in is a Bessel sequence if there exists 

a constant < (3 < +oo such that 

If in addition there exist constants < a < /3 < +oo such that 

a\\hr^<J2\{h,x,)\^ <f3\\h\\l, Vhen, 

then X is said to be a frame for 7i. The sequence X is a Parseval frame if a and /3 
can be chosen so that a — (3 — 1. 

The closure of the span of X wiU be denoted by span{xj}jg j. X is a frame 
sequence if it is a frame for span{a;j}jgj. 

Definition 2.2. A sequence X — {xj}j^j in 7i is a Riesz basis for H if it is 
complete in 7i and there exist constants < a < /3 < +oo such that 

Definition 2.3. li X = {xj}j^j is a Bessel sequence in H, we define the analysis 
operator as 

Bx-.n-^fiJ), Bxh^{{h,x^)}j^j. 
The adjoint of _B is the synthesis operator, given by 

B*x ■■ i^{J) -> T-i, B*xc = CjXj. 

The Bessel condition guarantees the boundedness of Bx and as a consequence, that 
of B*x. 

Definition 2.4. Suppose X = {xj}j(zj is a Bessel sequence in H and Bx is the 
analysis operator. The Gramian of the system X is defined by 

Gx -.fiJ) ^i^J), Gx .^BxB*x. 

We identify Gx with its matrix representation. 

{Gx)],k = {xk,Xj) Vj, fc e J. 

Given a Hilbert space £ and a bounded linear operator W : C C , we will 
denote by cr(W) the spectrum of W. 

The following is a well known property. Its proof can be deduced from [7l Lemma 
5.5.4], 

Proposition 2.5. Let X :— {xj}ji=,j QTi he a Bessel sequence, then X is a frame 
sequence with constants a and [3 if and only if 

fT(Gx) C{0}U [a, 

Definition 2.6. Let X {xj}j^j and Y :— {yi}i,^i be Bessel sequences in H.. 
Let Bx and By be the analysis operators associated to X and Y respectively. The 
cross- correlation operator is defined by 

Gx,Y ■■ e\J) ^ Gx,Y ByB*x. (1) 
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Identifying again Gx.y with its matrix representation, we write 

{Gx,Y)i,j ^ {xj,Vi) yjejyiel. 

We will need the following property of Parseval frames. 

Proposition 2.7. If X — {xjjjgj is a Parseval frame for a closed subspace S, 
and Bx is the analysis operator associated to X , then the orthogonal projection of 
Ti onto S is 

Ps - B*xBx -.n^K Psh = ^(ft, X,} Xj. 

Remark 2.8. A Parseval frame for a Hilbert space does not need to be an or- 
thogonal system. In fact, it is orthogonal if and only if every element of the set 
has unitary norm. A simple example is the family X = {"^ei, "^ei, e„}„>2 where 
{e„}n,gN is an orthonormal basis for the Hilbert space. X is a Parseval frame that 
is not orthogonal and it is not even a basis. 

3. The sampling operator 

Let 7i be a separable Hilbert space and 5 C H an arbitrary set. Given 5* — 
{'>Pi}iei ^ Bessel sequence in 7i, the sampling problem consists of reconstructing 
a signal f G S using the data {(/, V'i}}ie/- We first require that the signals are 
uniquely determined by the data. That is, if we define the Sampling operator by 

A:H-^f{I), Af ■.^{{f,A)}^eI, (2) 

we require A to be one-to-one on S. The set will be called the Sampling set. 

Note that the sampling operator A is the analysis operator for the sequence ^. 

Another important property that is usually required for a sampling operator, is 
stability. This is crucial to bound the error of reconstruction in noisy situations. 

The stable sampling condition was first proposed by [17] for the case when S is 
the Paley- Wiener space. It was then generalized in [19] to the case when is a 
union of subspaces. 

Definition 3.1. A sampling operator A is called stable on S if there exist two 
constants < a < j3 < +oo such that 

a\\xi - X2\\n < \\Axi - Ax2\\%(i) < P\\xi - X2\\h '^xi,X2 e S. 

When S* is a closed subspace, the injectivity and the stability can be expressed 
in terms of conditions on Ps^, where Ps is the orthogonal projection of Ti. onto S. 

Proposition 3.2. Let Ti. be a Hilbert space, S TL a closed subspace and ^ = 
{V'ilie/ Bessel sequence in Ti. If A is the sampling operator associated to then 
we have 

i) The operator A is one-to-one on S if and only if {Ps'>Pi}iei complete in 
S, that is S — spaii{Psipi}iei ■ 

ii) The operator A is stable on S with constants a and (3 if and only if 
{Psi^iliei a frame for S with constants a and (3. 

Proof. The proof of zj is straightforward using that if / e 5* then 
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For ii) note that for all / G 5* 

iei iei iei 

□ 

Remark 3.3. Given a closed subspace S' in a Hilbert space H, a sequence of vectors 
{ipi}iei C ?i is called an outer frame for S if {Ps'^ijig/ is a frame for 5*. The notion 
of outer frame was introduced in [T]. See also [H] and [TS] for related definitions. 
Using this terminology, part ii) of Proposition 13.21 says that the sampling operator 
A is stable if and only if {ipi} is an outer frame for S. 

In what follows we will extend one-to-one and stability conditions for the operator 
A, to the case of a union of subspaces instead of a single subspace. 

If {S-yl-ygr are closed subspaces of Ti, with F an arbitrary index set. Let 

X — U s^. 

ler 

We want to study conditions on so that the sampling operator A defined by 
(m is one-to-one and stable on x- 

This study continues the one initiated by Lu and Do [19j in which they translated 
the conditions on x into conditions on the subspaces defined by 

Sj^g := + Sg = {x + y : x e Sj, y £ Sg}. (3) 

Working with the subspaces Sj^g instead of x, allows to exploit lineal properties 
of A 

They proved the following proposition. 

Proposition 3.4. [19] With the above notation we have, 

i) The operator A is one-to-one on x if ond only if A is one-to-one on every 
S^^g with 7, 6* G F. 

ii) The operator A is stable for x with stability bounds a and (3, if and only if 
A is stable for S-y^g with stability bounds a and (3 for all 'y,9 lE T, i.e. 

a\\x\\ii < WAxWlf^j^ < f3\\x\\ii e 5^,9, V 7,0 gF. 

The sum of two closed infinite-dimensional subspaces of a Hilbert space is not 
necessarily closed (see Example 16. 9p . Furthermore, the injectivity of an operator 
on a subspace does not imply the injectivity on its closure. So, we can not apply 
Proposition [22] to the subspaces S.y^g. However, we can obtain a sufficient condition 
for the injectivity. 

Proposition 3.5. If {P-g ^'4'i}iei complete on S^,g for every 7, 6* G F, then A 
is one-to-one on x- 

When the subspaces of the family {S-f^g^^^g^r are all closed, the condition in 
Proposition 13.51 will be also necessary for the injectivity of A on x- So, a natural 
question will be, when the sum of two closed subspaces of a Hilbert space is closed. 
In Section [6] we study this problem in several situations. 

In the case of the stability. Proposition 13.21 can be applied since, by the bound- 
edness of A, we have the following. 

Proposition 3.6. Let S be a subspace of Ti., the operator A is stable for S with 
constants a and [3 if and only if it is stable for S with constants a and fi. 
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As a consequence of this, using Propositions 13.21 and part ii) of Proposition [3^ 
we have 

Proposition 3.7. A is stable forx with Constantsa and (3 if and only if{Pg ^i/'ilie/ 
is a frame for S-y^e for every 7, € F with the same constants a and [3. 

4. Union of finite-dimensional subspaces 

In this section we will first obtain conditions on the sequence for the 

sampling operator to be one-to-one on a union of finite-dimensional subspaces. We 
will then analyze the stability requirements. We are interested in expressing these 
conditions in terms of the generators of the sum of every two subspaces of the union. 

4.1. The one-to-one condition for the sampling operator. Let H be a Hilbert 
space, = {i}}i\i(zi a Bessel sequence in 7i, and A the sampling operator associated 
to as in 

Let S" be a finite-dimensional subspace of TL and $ = {(/'jlj^i a finite frame for 
S. (Recall that a finite set of vectors from a finite-dimensional subspace is a frame 
for that subspace if and only if it spans it.) 

The cross-correlation operator associated to ^ and $ (see ((I])) in this case can 
be written as, 

G<[>_i]> : — > i^i^I), G$^i]> = AB^, 

where : ^ H is the synthesis operator associated to 

The next theorem gives necessary and sufficient conditions on the cross-correlation 
operator for the sampling operator to be one-to-one on S. 

Theorem 4.1. Let ^' = {ipi}i,zj be a Bessel sequence for Ti, S a finite- dimensional 
subspace ofTi, and $ = {(t'j}'j=i a frame for S. Then the following are equivalent: 

i) ^' provides a one-to-one sampling operator on S. 

ii) ker(G'$,>t) = ker(i?|,). 

iii) dim(range(G'$^.p)) — dim(S'). 

Proof. The proof is straightforward using that the range of the operator B^ is 
S. □ 

Remark 4.2. Note that the conditions in Theorem 14.11 do not depend on the 
particular chosen frame. That is, if there exists a frame <i> for S, such that 
dim(range(G$_4()) = dim(5'), then dim(range(Gj ^)) = dim(iS'), for any frame $ 
for S. 

Now we will apply the previous theorem for the case of a union of subspaces. 
Let {Sj}jizr be a collection of finite-dimensional subspaces of Ti, with F an 
arbitrary index set. Define, 

X U S^. 

As before, set Sy^e ■= S-y + Se- 

We obtain the following result which extends the result in [19] to the case that 
the subspaces in the union are described by frames. 

Theorem 4.3. Let ^ — {ipi}i^i be a Bessel sequence for Ti. and for every 7, S F, 
let ^-y^e be a frame for Sj^g, the following are equivalent: 
i) ^' provides a one-to-one sampling operator on x- 
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ii) dim(range(G$_^ e,*)) = dini(5-,.,e) for all £T. 

Note that if / is a finite set, the problem of testing the injectivity of A on x 
reduces to check that the rank of the cross-correlation matrices are equal to the 
dimension of the subspaces Sj^g. 

In this case a lower bound for the cardinality of the sampling set can be estab- 
lished. This is stated in the following corollary from [19]. We include a proof of the 
result based on Theorem 14.31 

Here denotes the cardinality of the finite set /. 

Corollary 4.4. // the operator A is one-to-one on x o,nd I is finite, then 

#/ > sup {dim{S^,e)). 

■y.eer 

Proof. Since / is finite, we have that range(G$ g^ip) C C*^. Thus, using part ii) 
of Theorem 14.31 we obtain that 

dim(5^,e) = dim(range(G$^ < #/, V7, OeT. 

□ 

4.2. The stability condition for the sampling operator. We are now inter- 
ested in studying conditions for stability of the sampling operator. These conditions 
will be set in terms of the cross-correlation operator. We will consider Parseval 
frames to obtain simpler conditions. 

Given Hilbert spaces C and C and a bounded linear operator we 
denote by a^{W) the set 

(7^{W) = (7{W*W). 

Theorem 4.5. Let ^ = be a Bessel sequence for Ti, S a finite- dimensional 

subspace of Ti and $ a Parseval frame for S. 

The sequence ^ provides a stable sampling operator for S with constants a and 
(3 if and only if 

i) dim(range(G$.*)) ~ dim(S') and 

ii) (G$^^) c {0}U [a,/?]. 

Proof. Let W : H ^ ^^(-^)j be the analysis operator associated to Ps^'- For x & Ti, 
the equation, 

Wx = {{x,Psi}^)}^eI = {{Psx,^,)hei = APsx, 

shows that W = APs. 

Since <i> is a Parseval frame for S, by Proposition [2?7l Ps ~ B^B^ then, 

Gp,^ = WW* = APsPsA* = APs A* = AB^B^A* = G*,*G^,^. (4) 

Let us assume first that A is stable for S. Item i) follows from Theorem 14.11 
Now we prove ii). 

Since S is closed {S is finite dimensional) then Proposition l3. 21 gives that Ps'^ :— 
{Psi^i\iei is a frame for S with constants a and (3. Using Proposition l2.51 we have, 

o-(Gpg*) C {0}U [a, [3]. 

So, by Q, 

a(Gps*) = ct(Gce,,*G|,_^) C {0} U [a, (3]. 
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Finally, since (see pT] ) 

c(G'|,_^G$_*) C {0} U ct(G$^ii.G|,^^), 

it follows that 

cr^(G<E,,*) C {0}U [a,/3]. 
Suppose now that i) and ii) hold. Recall that A is stable for S with stability 
bounds a,/? if and only if Pg^* := {-PsV-'ijiG/ is a frame for S with frame bounds 
a, p. 

By Theorem 14. 1[ condition i) implies that the sampling operator is one-to-one 
on S. Thus, using Proposition 13.21 Ps^E' := {Psi^ijiei is complete in S. 

That Ps'^ := {PsV'Oie/ is a frame sequence is straightforward by ii), and 
Proposition [^31 □ 

Remark 4.6. As in the case of injectivity, we note that the condition of stability 
does not depend on the chosen Parseval frame. That means, if condition i) and ii) 
in the previous theorem hold for a Parseval frame $ for S, then they hold for any 
Parseval frame $ for S. 

Theorem 14.51 applied to the union of subspaces gives: 

Theorem 4.7. Let 4' = {V-'ilie/ be a set of sampling vectors and for every 7, £ 
let $^_6i be a Parseval frame for S^,e- 

The sequence ^' provides a stable sampling operator for x with constants a and 
(3 if and only if 

i) dim(range(G$^ e,*)) = dim(S'-y_e) for all 7,6* e F and 

ii) cr2(G^^^_^) c {0} U [a, (3] for all 7, 6* e F. 

For examples and existence of sequences which verify the conditions of injec- 
tivity or stability in a union of finite-dimensional subspaces, we refer the reader to 
[3] and [H]. 

5. Sampling in a union of finitely generated shift-invariant spaces 

In this section we will consider the case of the Hilbert space 7i = L^(K") and 
finitely generated shift-invariant spaces (FSISs). That is, we will study sampling in 
a union of FSISs. 

We will first review some properties of these spaces. For a detailed treatment 
see [U [6l [ISl [22] and the references therein. 

5.1. Some basic facts about shift-invariant spaces. We use the Fourier trans- 
form defined by 

for / e L^(K"), and extended to be a unitary operator on L^(R"). 
T" = M^/Z" is the torus group, identified with [0, 1)". 
The translation by fc £ Z" is denoted by tkf '■— /(• — k). 

Definition 5.1. A closed subspace S C ^^(R") is a shift-invariant space (SIS) if 
f e S implies tkf G S for any A; G Z". 

Given $ a set of functions in L^(]R"), we denote by E{^) the set, 

-&($) := {ifc0 : k e Z",0 e $}. 
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The SIS generated by this set is 

:= spaS(£;($)). 

U S = S{^) for some finite set $ we say that 5 is a finitely generated shift-invariant 
space (FSIS). 

If S is an FSIS, we caU the length of S, the cardinality of a smallest generating 
set for S, and write 

len(S') := min{#$ : S = S{^)}. 

Although the FSISs arc infinite-dimensional subspaccs, most of their properties 
can be translated into properties on the fibers of the spanning sets. That allows to 
work with finite-dimensional subspaces of £^(Z"). We will give the definition and 
some properties of the fibers. 

The Hilbert space of square integrable vector functions L^(T", ^■^(Z")), consists 
of all vector valued measurable functions F : T" — > £^(Z") such that 

IIJ^II :=[Jj\Fix)\\%dxy, 

is finite. 

Proposition 5.2. The function r : L^(R") L^{T"',e{Z"')) defined for f G 
L^{W) by 

r/H ■.^{f{u; + k)}kez^, 
is an isometric isomorphism between L^(R") a^rf i^(T", £^(Z")). 
The sequence {/(w + k)}keZ" is called the fiber of f at to. 

Definition 5.3. A range function is a mapping 

J : T" ^ {closed subspaces of ^^(Z")}. 

J is measurable if the operator valued function of the orthogonal projections u 
Pj(oj) is weakly measurable. 

Note that in a separable Hilbert space measurability is equivalent to weak mea- 
surability. Therefore, the measurability of J is equivalent to w -^^(w) i^') being 
vector measurable for each a € £^(Z"), or w Pj(^)(i^(u;)) being vector measur- 
able for each fixed vector measurable function F :T" ^ £^(Z"). 

Proposition 5.4. A closed subspace S C L^(R") is shift-invariant if and only if 

S = {f e L2(R") : Tf{Lj) e Js{uj) for a.c. uj G T"}, 

where Js is a measurable range function. The correspondence between S and Js is 
one-to-one. 

Moreover, if S = S{^) for some countable set $ C L2(R"), then 
Jsi^) = span{T(/)(cj) :(/)£$} for a.e. u € T". 
The subspace Jsi^^) is called the fiber space of S at lo. 
Proposition 5.5. Let S be a SIS o/L2(K") and f G L2(R"), then 
T{Psf){Lo) = P;,.(^)(t/(^)) for a.e. u G T". 

Definition 5.6. Given S a SIS of L^(M"), the dimension function associated to S 
is defined by 

dims : T" ^ No U {oo}, dims(a;) = dim(Js(a;)). 
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Here No denotes the set of non-negative integers. 

The next two theorems characterize Bessel sequences, frames and Riesz bases of 
translates in terms of fibers. 

Theorem 5.7. Let ^ be a countable subset of L'^{M"). The following are equivalent. 

i) E(^) is a Bessel sequence in L^(M") with constant /3. 

ii) T$(w) := {Tif){uj) : G $} is a Bessel sequence in £^(Z") with constant j3 
for a.e. cj G T". 

Let $ = be a countable set of functions in _L^(R") such that E{^) is a 

Bessel sequence. The Gramian of $ at G T" is 

g^{uj):e{j)-^e{j), = (r0jH,T0,H)p(z„) Vi,jGj. 

Note that is the Gramian operator associated to the Bessel sequence {r(/)j(ci;)}jgj 

in that is g^{uj) = G'^$(„), (see Definition [131) . 

Theorem 5.8. Let S — S{^), where ^ is a countable subset o/L^(E"). Then the 
following holds: 

i) E(^) is a frame for S with constants a and [3 if and only if T$(aj) is a 
frame for Js{^) with constants a and [3 for a.e. to € T". 

ii) is a Riesz basis for S with constants a and (3 if and only if t^{lu) is 
a Riesz basis for Js(ti') with constants a and (3 for a.e. w G T". 

Furthermore, if $ is finite, S has a Riesz basis of translates if and only 
if the dimension function associated to S is constant a.e. lo T". 

Let us remark here that if $ C L^(R") is a set of generators for a shift-invariant 
space S, that is S = 5'($), then the set E[(^) does not need to be a frame for S, 
even for finitely generated SISs. However it is always true that there exists a set 
of generators for S such that its integer translates form a frame for S. This is the 
result of the next theorem. 

Theorem 5.9. Given S a SIS of L'^{W^), there exists a subset $ = {4>j}j£j C S 
such that is a Parseval frame for S. If S is finitely generated, the cardinal of 

J can be chosen to be the length of S. 

Although a SIS always has a frame of translates, there are SISs which have 
no Riesz bases of translates. For example, consider the shift-invariant space S 
generated by (/> G where (j){Lu) — X[q,^){^)- Since dim5(w) — 1 for a.e. 

w G [0, |) and dims(w) = for a.e. ui G 1), it follows by Theorem 15.81 that S 
has no Riesz bases of translates. 

5.2. Sampling from a Union of FSIS. In this section we will study the sampling 
problem for the case in which the signal belongs to the set, 

X := U S^, (5) 

where S-y are FSISs of ^^(K"). 

In this setting, since our subspaces are shift-invariant, it is natural and also 
convenient that the sampling set will be the set of shifts from a fixed collection of 
functions in L^(]R"), that is, the sampling operator will be given by a sequence of 
integer translates of certain functions. 
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Given ^ :— such that is a Bessel sequence in L^(M"), we define 

the samphng operator associated to £'(5') as 

A : L\W") ^ e\Z'' X /), Af - {(/,tfcV.)}.6/,fc6Z". (6) 

As we showed in Section[3]the conditions on the samphng operator to be one-to-one 
and stable in a union of subspaces can be estabhshed in terms of one-to-one and 
stabihty conditions on the sum of every two of the subspaces from the union. 

However the condition that we have for the samphng operator to be one-to-one 
on a subspace, requires that the subspace is closed (Proposition 13. 2p . 

Since the sum of two FSISs is not necessarily a closed subspace, the conditions 
should be imposed on the closure of the sum. 

Conditions that guarantee that the sum of two FSISs is closed are described in 
Section [6l 

In what follows we will consider, for each 7, 6' G F, the subspaces, 

S.y^e '■= + Se- (7) 

The following proposition states that the closure of the sum of two SISs is a SIS 
generated by the union of the generators of the two spaces. Its proof is straightfor- 
ward. 

Proposition 5.10. Let $ and be sets in L^(E"), then 

's(WjTs(Wj ^ s{<s> u $')• 

In particular, if S and S' are FSISs, then S + S' is an FSIS and 

\en{S + S') < \en{S) + lcn(5'). 

Now, as a consequence of Proposition 15. 10[ for each -f,9 £T, Sj^g is an FSIS. 
Then, by Theorem 15. 9i we can choose, for each 7, 6* G F, a finite set 

of L^(M") functions such that, 

Sj^g = S{^j^g), 

and £'($^.6)) forms a Parseval frame for S-y^. 

5.3. The one-to-one condition. We now study the conditions that the sampling 
set must satisfy in order for the operator A defined by ^ to be one-to-one on x- 

Given a shift-invariant space S, the orthogonal projection onto S, denoted by 
Ps, commutes with integer translates. Then, part i) of Proposition 13.21 can be 
rewritten as. 

Proposition 5.11. Given a shift-invariant space S, 4* = {'ipi}iei such that E{'^) 
is a Bessel sequence in L^(M") and A the sampling operator associated to E{'^). 
Then the following are equivalent. 

i) The sampling operator A is one-to-one on S. 

ii) E{Ps^) — {tkPs4'i}iei,kei," "is complete in S, that is S ^spanE{Ps'^). 

Since E{'^) is a Bessel sequence in L^(M"), by Theorem 15.71 we have that 
{T'ijji{ui)}i^i is a Bessel sequence in i!^(Z") for a.e uj G T", so we can define (up to 
a set of measure zero), for w G T", the sampling operator related to the fibers: 
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with 

A{Lo){c) = {{c,Ti^,{u;))},^i. (8) 

That is, for a fixed G T", we consider the problem of sampling from a union of 
subspaces in a different setting. The Hilbert space is ^^(Z"), the sequences of the 
sampling set are {r'0i(u;)}ig/, and the subspaces in the union are Js^{uj),j G T. 

Since the subspaces S-y^e are FSISs, the fiber spaces Jg (uj) are finite-dimensional. 
So, the results of Section 3] can be applied, and conditions on the fibers can be ob- 
tained in order for the operator A{ll!) to be one-to-one. 

We are now going to show that given a finitely generated shift-invariant space 
S, the operator A is one-to-one on S if and only if for almost every a; £ T", the 
operator A{uj) is one-to-one on the corresponding fiber spaces Js{uj) associated to 
S. Once this is accomplished, we can apply the known conditions for the operator 

AiLu). 

Given {tk4'j}'j=i fceZ" ^ Bessel sequence in L^(R"), we have the synthesis oper- 
ator related to the fibers, that is 

d 

BUi^) -.C^ ^f{Z"), H;M(ci,...,Cd) =^c,t0jH. (9) 

Note that B^{uj) is the synthesis operator associated to the set t$(cj), that is 
And we will have the cross-correlation operator associated to the fibers 

(e<E.,*(w))^J = (T</)j(t^),rV'»(c^)) yi<j<d,iel. (10) 

Again we should remark that is the cross-correlation operator associated 

to T^{uj) and t^(cl;), that is g<i>,^{u!) = Gr<s>{Lu)^T^{i^)- 

Theorem 5.12. Let = be such that E{'i>) is a Bessel sequence in L^(IR"), 

S an FSIS generated by a finite set $, and A the sampling operator associated to 
E[^), then the following are equivalent: 

i) ^' provides a one-to-one sampling operator for S. 

ii) ker(a<E,,*(w)) = ker(B|(w)) for a.e. w e T". 

iii) dim(range(Cy$.*(ijj))) — dim5(w) for a.e. lu G T". 

For the proof of Theorem 15 . 1 21 we need the following. 

Lemma 5.13. Let S be an FSIS, \l/ = {'0i}ie/ such that is a Bessel sequence 

in L^(R"), and A the sampling operator associated to E{'i>). Then A is one-to-one 
on S if and only if A{lo) is one-to-one on Js(^) for a.e. cj G T". 

Proof. Since S is a SIS, by Proposition [STTll A is one-to-one on S if and only if 

S ^spa^EiPs'i'). (11) 

By Proposition [5T11 equation pT|) is equivalent to 

Js{uj) = sps^{r{Psipi){t^) : « G /} for a.e. uj eT\ (12) 

So, we have proved that A is one-to-one on S if and only if p2|l holds. 



SAMPLING IN A UNION OF FRAME GENERATED SUBSPACES 



13 



On the other side, given lo E T", and using Proposition 13.21 for the sampUng 
operator A{uj) and the space H — £^(Z"), we have that A{uj) is one-to-one on 
Js{lu) if and only if 

Js{uj) = span{Pjg(^)(TV'i(w)) : i £ /}. 

Then, using Proposition 15.51 we conclude that holds if and only if A{llj) is 
one-to-one on Js(w), for a.e. ui G T", which completes the proof of the lemma. 

□ 

Proof of Theorem \5.1SX Since <I> is a set of generators for 5, we have that for a.e. 
a; S T", r$(a;) is a set of generators for Js(w). 

Now, for a.e. w £ T" we can apply Theorem 14.11 for the sampling operator A{lo) 
and the finite-dimentional subspace Js{^) to obtain the equivalence of the following 
propositions: 

a) A{lo) is one-to-one on Js(w). 

b) ker(g$,*(w)) =ker(B|(Lj)). 

c) dim(range(C7$^*((jj))) = dim(J5(w)) = dim5(w). 

From here the proof follows using Lemma 15.131 

□ 

Note that with the previous theorem we have conditions for A to be one-to-one 
on 5*7, e, and since 

S'yfi = + Sg Sj^e, 
we obtain the following corollary. 

Corollary 5.14. Let E{'^) be a Bessel sequence in L^(R") for some set of functions 
For every 7, G P, let $7,9 be a finite set of generators for S-y^g. If for each 

1,0 er, 

dim(range(t/$^ g ^15(0-1))) = dim^ ^(uj) for a.e. lo G T", 
then A is one-to-one on x- 

Remark 5.15. It is important to note that the injectivity of A on S^^g does not 
imply the injectivity on S'.y^g, thus, we have only obtained sufficient conditions for 
A to be one-to-one. This is not a problem in general, because as we will see in the 
next section, stability implies injectivity in the case of the sampling operator and 
stability is a common and needed assumption in most sampling applications. 

5.4. The stability condition. As a consequence of ProDOsition l3.61 wc will obtain 
necessary and sufficient conditions for the stability of A. 

As in the previous subsection, using that the orthogonal projection onto a SIS 
commutes with integer translates, we have the following version of Proposition 13. 21 

Proposition 5.16. Given S a SIS of L'^{W'), ^ = {-0J»e/ such that E{^) is a 
Bessel sequence in L^(R"') and A the sampling operator associated to E(^/). Then 
the following are equivalent: 

i) The sampling operator A is stable for S with constants a and (3. 

ii) E{Ps^) is a frame for S with constants a and (3. 

Now we are able to state the stability theorem. We will use the operator related 
to the fibers, defined bv ((8|l. (|9| and pOjl . 
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Theorem 5.17. Let 4* = {'>pi}iei be such that E{'i') is a Bessel sequence for 
Z/^(IR") and A the sampling operator associated to Let S be an FSIS, and 

a finite set of functions such that E{^) forms a Parseval frame for S. 
Then i?(\E') provides a stable sampling operator for S if and only if 

i) dim(range(t7$^(a;))) = dim5(ti;) for a.e. e T" and 

ii) There exist constants < a < /? < oo such that 

cr^{g^,^{uj)) C {0}U [a,/3] for a.e. u e T\ 

Proof. $ is a Parseval frame for S, so, by Theorem l5.81 we have that for a.e. a; G T", 
T$(a;) is a Parseval frame for Js{lo). Since Jsi^^) is a finite-dimensional space of 
Theorem 113] holds for A{lu). 

So, we only have to prove that A is stable for S with constants a and /3 if and 
only if A{u!) is stable for Jsii-o) with constants a and (3. 

By Proposition I5.16| the stability of A in S' is equivalent to E{Ps'i') being a 
frame for S with constants a and (3. By Theorem 15.81 this is equivalent to 

{T{Ps4'^){t0)}^eI 

being a frame for Js(w) with constants a and f3 for a.e. w G T". 

On the other hand, given e T", the operator A{lli) is stable for Js(w), if and 
only if 

is a frame for Js(aj) with constants a and /3. 

The proof can be finished now using first Proposition [531 i-C- 

t{Ps^,){u;) = Pj^(^)(tiA»(w)) for a.e. cu S T", 

and then Theorem 14.51 □ 

Now we apply Theorem 15. 171 and Proposition 13 . 61 to obtain the following. 

Theorem 5.18. Let '3/ = {'(/'i}ie/ such that E{'i>) is a Bessel sequence for L^(M"), 
and for every 7, £ P let $7,6/ be a Parseval frame for S-y^e. Then E(JS!) provides 
a stable sampling operator for x if o,nd only if 

i) dim(range(Cy$^ g^,i,(a;))) = dim^ ^(uj) for a.e. uj G T", V7,6' G P and 

ii) There exist constants < a < (3 < 00 such that 

fT'(e<E.,..,*(^)) C {0} U [a, /?] for a.e. uj G T", V7, G P. 

Finally, as in [19, , we obtain a lower bound for the amount of samples. In contrast 
to the previous section, we only find bounds for stable operators. We can not say 
anything about one-to-one operators since we only obtained sufficient conditions 
for the injcctivity. 

Proposition 5.19. // the operator A is stable for x cmd I is finite, then 

#L> sup (len(^^,e)). 

7,eer 

Proof. Since / is finite, it holds that range(C/$^ ^^^(w))) C C'^^ for a.e. u) G T". 
Hence, by Theorem 15.181 we have that 

dim^^ ^(w) dim(range(e$^^,,*(w))) < #/ for a.e. uj G T", V7,6' G P. 

This shows that, given 7,0 G P, 

ess-sup {dim^ ^(cj) : cj G T"} < #/. 
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The proof of the proposition follows using ^ Theorem 3.5]. 

□ 

We would like to note that based in our results, it is possible to state conditions 
for the injectivity and stability for the sampling operator in a union of SISs which 
are not necessarily finitely-generated. For this, condition iii) of Thcorem IS . 1 2l should 
be replaced by condition ii). 

6. Necessary and sufficient conditions for the closedness of the sum 

of two sis. 

In this section we review the conditions for the sum of two closed subspaces of 
a Hilbert space to be closed. Then we apply the results to the class of FSISs in 
L2(R"). 

6.1. Closedness of the sum of two subspaces of a Hilbert space. Through- 
out this section H will be a separable Hilbert space. 

If 5 is a closed subspace of TC, we write Ps for the orthogonal projection onto S. 
Given U and V closed subspaces of ?i, we will use the symbol Pu\y to denote the 
restriction of Pu to the subspace V. 

The orthogonal complement oi U OV in U will be denoted by 

UQV ■.= ur\{unv)-^. (13) 

If ^ : 7i — !■ 7i is a bounded linear operator, we will use the norm 

11.11 W^^W 

The conditions on the closedness of the sum of two closed subspaces of 7i will 
be given in terms of the angle between the subspaces. We refer the reader to [TU] 
for details and proofs. 

Definition 6.1. Let U and V be closed subspaces of H. 

a) The minimal angle between U and V (or Dixmier angle) is the angle in 
[0, -j] whose cosine is 

Co[U,V] :=sup{|(u,w)| : u^U,v^V,\\u\\< 1, ||«|| < 1}. 

b) The angle between U and V (or Friedrichs angle) is the angle in [0, ^] 
whose cosine is 

c[U,V] ■.^sup{\{u,v)\ : uGUqV,vGVqU and \\u\\ < l,\\v\\ < 1}. 

Now we state some known results concerning both notions of angles between 
subspaces. 

Proposition 6.2. Let U and V be closed subspaces oJTL. 

i) C0[U,V] = \\Pu\y\\. 

ii) c[u,v] = cq[u ev,v QU]. 

iii) U + V is closed if and only if c[U, V] < 1. 

Let H and K, be separable Hilbert spaces, and T : H ^ K. a bounded linear 
operator with closed range. We denote by T^, the pseudo- inverse of T (see (T] for 
definition and properties). 
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The following theorem provides a formula which gives an easy way of calculating 
the angle between two subspaces using operators associated to frames. Its proof 
follows from [TB] Theorem 2.1] and part ii) of Proposition 16.21 

Theorem 6.3. Let U and V he closed subspaces ofH. Suppose that X and X' are 
countable subsets of Ti. which are frames for U QV and V QU respectively. Then, 

c[U,V]^\\{Gl)^Gx.X'iG^x)^l 

where Gx and Gx' are the Gramian operators and Gx,X' is the cross- correlation 
operator. 

6.2. Closedness of the sum of two shift-invariant subspaces. As it was 

stated in Proposition 16.21 the closedness of the sum of two subspaces depends 
on the Friedrichs angle between them. In this section, we provide an expression for 
the Friedrichs angle between two SISs in terms of the gramians of the generators. 
In [16j Kim et al has found a similar expression for the Dixmier angle between two 
SISs. 

The main theorem of this part gives necessary and sufficient conditions for the 
sum of two SISs to be closed. We first state the theorem and then we apply this 
result to obtain a more general version of Corollarv l5.14l The proof of the theorem 
will be given at the end of the section. 

Theorem 6.4. Let U and V be SISs of L'^{W"). Suppose that $, $' are sets of 
functions in L^(M") such that for a.e. uj G T", r$(w) and T$'(a;) are frames for 
JuQv{uj) and Jvqu{^) respectively. Then, U -\-V is closed if and only if 

c[C/,y] = ess-sup {||(g$'(w)t)^e?<E,.*'('^)(^^<E>('^)^)^ II :t^eT"}<l. (14) 

Note that, if S* = S{^) is an FSIS, we have that t$(w) is a frame for Js{'^) for 
a.e. e T", even though E{^) is not a frame for S. Thus, if U and V are FSISs, 
condition ([T3|) can be checked on any set of generators of the subspaces U QV and 
V QU . At the end of the section we give an example in which we compute the 
Friedrichs angle between two FSISs. 

In the next theorem we show that imposing certain restrictions on the angle 
between the subspaces, we obtain necessary and sufficient conditions for the injec- 
tivity of the sampling operator. This gives a more complete version of Corollary 

Theorem 6.5. Let = {V'j}iG/ such that E{'^) is a Bessel sequence in L^(R") 
and suppose condition \14^ is satisfied for every 7, e F. If ^^^g is a finite set of 
generators for Sryfi, the following are equivalent: 

i) ^' provides a one-to-one sampling operator for x- 

ii) dim(range(t;$^ g,^(w))) dim5^ g(w) for a.e. lu e T\y^,e G F. 

Proof. Since condition (fT4)) is satisfied for every 7, 6* G F, it holds that the subspaces 
S^fi are FSISs. The proof of the theorem follows applying Theorem 15.121 to these 
subspaces. 

□ 

In what follows we will give some lemmas which will be needed for the proof of 
Theorem 16.41 The results in these lemmas are interesting by themselves. 

The first lemma uses the notion of range function introduced in Definition 15.31 
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Lemma 6.6. Given U and V SISs of L'^{W'). Then the range function 

i? : T" ^ {closed subspaces o/€^(Z")}, R{uj) = Ju{io) Ci Jy(w), 
is measurable. 

Proof. Recall that the measurability of R is equivalent to a; ^ Pjuiuj)nJvi<^) being 
measurable. 

It is known (see [20]) that given M and N closed subspaces of a separable Hilbert 
space H, for each x €Ti, 

PMnN{x)= lim {PmPnT{x). 

n — *+oc 

Note that if we have two measurable functions 

Qi, (32 : T" ^ {orthogonal projections in ^^(Z")}, 

then the map lu Qi{'-^)Q2{'-^) is measurable. For, let F be an arbitrary measur- 
able function from T" into ^^(Z"). Then 

Q,{Lu)Q2iu){Fiuj)) = Q,{lu){Q2{uj){F{lu))). 

By Definition 15. 3i the measurability of (52 (t^) implies the vector measurability of 
Q2{io){F{uj)). Since Qi{uj) is measurable, Qi{lj)Q2{uj){F{uj)) is measurable. What 
shows that uj i-^ Qi{uj)Q2{to) is measurable. 

As a consequence, it holds that for any n G N the map cj i-^ {Pju(uj)Pjv('^))"' is 
measurable, that is, for each a e £^(Z"), lo ^ {Pju{uj)Pjv{i^))"{^) is measurable. 
From here the proof follows using that, 

Pju{^)nJvi^)i"') = ^_^^^^{Pjuiuj)Pjviuj)ria)- 

□ 

With the previous lemma we obtain the following property of the fiber spaces. 

Lemma 6.7. Let U and V be SISs of L^{W). Then, 

Juevi'^) — Ju{^) O Jv{'^) for a.e. 6 T". 

Proof. We will first prove that 

Junvi^) = Ju{^) ^ Jv{(^) for a.e. w G T". (15) 

Let R be the measurable range function defined in Lemma 16.61 Since 

UnV = {f € L2(R") : t/(w) G R{uj) for a.e. lu G T"}, 

it follows that R is the range function associated to the shift-invariant space UCiV, 
thus (Uni) holds. 

Using p^ . the proof of the proposition is straightforward as 

(Js(w))^ ^ Jg±{uj) for a.e. lo G T", 

for any shift-invariant space S of iy^(M"). □ 

The next lemma follows the ideas from fS]. It states that the angle between 
two shift-invariant spaces is the essential supremum of the angles between the fiber 
spaces. 

Lemma 6.8. Let U and V be SISs of L'^{W'). Then, 

c[U,V] = ess-sup {c[Ju{lj), Jv{lo)] : uj G T"}. 
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Proof. Given f € V, by Proposition [531 we have for a.e. uj £ T", 

r{Pu\yf){uj) = r{PuPvf){io) = Pj„i^)Pj,i^){rf{u;)) = Pj^^^)\j^^^^{rf{u;)). 

This shows that Pj^j(uj)\j ^^-j is the range operator corresponding to the shift- 
preserving operator ^Vjy in the shift-invariant space V. What impHes that 

\\Pu\y\\ = ess-sup : ^ e T"} (16) 

(see [6] for the definition and properties of shift- preserving operators). 
Using pB]) . Proposition 16.21 and Lemma [6771 we obtain 

c[U, V]=co[UeV,VeU]^ WPuevly^J 

= ess-sup {||^",/„evMl,7^g„(^)ll : ^ ^ T"} 

= ess-sup {||Pj^(^)ej^(^)[^^(^jQ^^(^j II : w e T"} 

= ess-sup {co[Jc/(w) O ^^(1^^), Jvi^^) O Jui^)] ■ ^ G T"} 
= ess-sup {c[Ju[uj), Jy(w)] : G T"}. 

□ 

With the above results, we are able to prove the main theorem of this section. 

Proof of Theorem \6.4\ By Lemma [6. 7[ it follows that T$(a;) and t^'{uj) are frames 
for Ju{i^) O Jv{^) and Jv(w) Ju{'-^) respectively, for a.e. G T". 
Thus, using Theorem 16. 3[ we obtain 

c[Jt/(u;), Jy(w)] = ||(g$'(w)t)^g$,$,(cj)(e;$(co)t)^|| for a.e. G T". 

Hence, by Lemma [6.81 

c[C/,y] = ess-sup {||(a$'(w)^)^e$,$-(cc;)(g$(cc;)t)^|| : G T"}. (17) 

The proof of the theorem follows from p?l) and Proposition 16.21 □ 

Next we provide an example of two shift-invariant spaces whose sum is not closed. 
In order to prove that, we compute the Friedrichs angle between the subspaces. 

Example 6.9. Let ipi G L^(M) be given by 

{cos(27ra;) if < cj < 1 
sin(27rijj) if 1 < < 2 
otherwise, 

and ^piT^p-i G L^(IR) satisfying that </32(ijj) — x^.z^iy^) and V'3('^) = X[3.4)('-^)- Define 
V = S'((/3l, (^2,(^3) • 

Consider now lySoi V4 £ -^^(1^)7 such that t^ol'^) = X[o.i)('^) and 1^94 (w) = X[| 
set V = S{(po,(p4). 

We will prove that U + V is not closed using Theorem 16.41 

Let {efcjfcgz be the standard basis for £^(Z). Then, T(pi(uj) = cos(27ra;)eo -I- 
sin(27rw)ei, T(p2{uj) = 62, Tip3{uj) = 63, T.^o(t^) = sq, T(p4{uj) ^ e3X[o,i)(w) + 
e2X[i i)(^)- So, we have that for a.e. uj G [0, 1), 

Ju{uj) Q Jv{i^) = span{T(pi{uj),T(p5{oj)} and Jy (w) G J(7(w) = span{Ti^o('^)}, 

where (fisiuj) = X[2,^){^) + X[i,4) (^)- Thus, by Lemma [6771 it follows that U QV = 
S{ipi,(p5) andV ell ^ S{ipo). 
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Let $ :— {ipi,ip5} and := {fo}, then 




and C/<i,^$'(w) = (cos(27r[j), 0). 



Therefore 

c[C/,y] = ess-sup {|i(e*.Mt)5g$,$,(w)(g$(u;)t)^|| : c^e[0,l)} 
= ess-sup {| cos(27rcj)| : uj £ [0, 1)} — 1. 

Hence, by Theorem 16.41 U + V is not closed. 
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